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Abstract. The invertibility of integral linear operators is a major problem of both 
theoretical and practical importance. In this paper we investigate the relation between 
an operator invertibility and the rank of its integral kernel to develop a local inverse 
theory. An operator is called locally invertible provided that any function can be 
recovered from its transformed image if the latter is known in an arbitrary open subset 
of its domain, i.e., if its image is known locally. It turns out that the local invertibility 
holds for any analytical kernel whose Taylor functions are linearly independent in any 
open subset of their domain - the so-called local linear independence condition. We also 
establish an equivalence between local linear independence and the so-called full rank 
a.e. property. The latter can be described as follows: for any finite, random sample of 
points, the square matrix obtained by applying, pairwise, the kernel function on them, 
has full rank almost surely. As an illustration, we show that the geodesic distance 
function on a sphere in more than one dimensions is of full rank a.e., in contrast to 
the Euclidean distance which is not. 



AMS classification scheme numbers: 47G10, 15A03, 15A29 
1. Problem Formulation and Motivation 

A large class of linear inverse problems arises from the Fredholm integral equation of 
the first kind 

^ix,y)f{y)dy = g{x), x e U, (1) 

where U and V are open sets in M" and /: M, 5? :[/—)■ M, and ijj : U x V R 

are some functions. The so-called kernel ip defines a linear operator A^, allowing ([1]) 
to be conveniently written as A^f = g. Typically, / and g are elements of the L^- 
spaces L'^{V) and L'^{U), while ip is a Hilbert-Schmidt kernel, in which case A^ is 
a compact linear operator. Notable examples of A^ are the Laplace transformation 
in M with kernel il){x^y) = exp(— xy) and the closely related Fourier transformation, 
ip{x,y) = exp{—ixy). Without being specific, we shall assume that ([1]) is formulated in 
sense for some p > 1. 
Let us assume that for given g, is solvable. Under some favorable conditions, a 
numerical solution of ([T]) can be obtained using a quadrature method by samphng the 
functions /, g and ip at discrete sets of points. Let U = Uf^^?7j and V = U^^iVj be 
partitions of the closures U and V such that Ui and Vj are open and disjoint. Let also 
{xj}*L]^ and {yi}*L]^ be two sets of points such that Xi G Ui and yj G Vj. Then, we can 
discretize equation ([1]) to 

k 

^ip{xi,yj)f{yj)vol{Vj)=g{xi), i = l,...,k, (2) 
i=i 

a system of linear equations. System ([2]) can be solved for = only if 

the matrix A^ = {ip{xi,yj)}ij^i is invertible, or equivalently, has full rank k; then 
the solution is fk{y) = Y.'}=i fkAvjiv), for the vector {fk,j)j=i = WkA^^g^, where 
Wk = diagillvoliVj)) and gu = {g{xi))i^i. Let us assume that A^ is invertible and 
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for a sequence of nets {a^j, k = 1,2,..., converges uniformly to A^ and gk 

converges uniformly to g. Then, any convergent subsequence of fk will approximate the 
solution of ([1]) (more details are given in the concluding section). Even though often, 
such as for compact A^, A'^^ is unbounded and convergent subsequence of fk may not 
be available, the solvability of equation (E]) is an interesting question by itself that is 
relevant to many problems with discrete nature. 

Usually, the sample points {xi,yj) are chosen in a deterministic way, for example, 
according to uniform spacing. However, in order to formulate a more general problem 
regarding the invertibility of Ak, we introduce the following stochastic setting. Let the 
points Xi and yj be chosen independently by some continuous distributions on U and 
V, respectively. Then, the rank of A^ becomes a 2 fc- dimensional continuous random 
variable. We are interested in the question: what property of the kernel guarantees 
that for every k, Aj, has full rank almost surely (a.s.)? If this is the case, we shall say 
that has full rank almost everywhere (a.e.) in its domain. 

The main focus of this paper is the characterization of the full rank a.e. kernels. We 
first need to define them properly. A possible approach is to simply reverse the standard, 
finite rank definition and say that a kernel ip has full rank, if it does not admit a finite 
sum representation ip{x,y) = '^^i(pi{x)C,i{y) for linearly independent (pi - finite rank 
linear operators are considered in all textbooks on the subject, see for example $70 in 
[1]. This approach however will be inadequate, for thus defined full rank kernels may 
not be of full rank in "a.e." sense, as the following example shows. In L^[0, 1], consider 
the functions 

Cs{,x) = l[s s±i^(x), s > 0, 

and let ipi^x^y) = X]^o j\,^s{x)y'^ - we call analytic in y all kernels ip that admit such 
Taylor expansion. Note that, as defined, are linearly independent in [0, 1] and thus, 
ilj{x,y) has no finite rank in sense of the standard definition. On the other hand, for 
any k points Xj and yj, sampled uniformly in [0, 1], there is a positive probability for 
Ak to have rank 1, and hence, ip is not of full rank a.e. in [0,1]. Evidently, for the 
latter to hold, Cg need to be linearly independent in a neighborhood of any point of 
their domain. We shall call the latter requirement on Cg local linear independence. In 
the example above, Cg are linearly independent but not locally linear independent. The 
main result in the paper is about rigorously showing the equivalence between the full 
rank a.e. property of analytical kernels and the local linear independence of their Taylor 
functions. 

Local linear independence is a necessary condition for the solvability of some classes 
of integral equation problems. Our interest in this topic started with the study of the 
so-called variance linear operator in the domain of probability density functions. More 
generally, in ([T]), let ?7 and V be open subsets of M", and ip{x, y) = d{x, y) be a distance 
function in M". Consider the operator Cu 

{Cuf){x)= / d\x,y)f{y)dy,x eU, 
Jv 
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where / G P(V), a class of measurable functions in V with finite moments of all orders. 
If cP is analytic my eV, (f{x,y) = Xl^o then the local linear independence of 

Cs in U will guarantee the invertibility of Cw for any open W G U (for more details see 
the concluding section). Consequently, there will be a one-to-one map between F{V) 
and the space of variance functions from the image Cw(^{V)). With other words, any 
element of ¥{V) can be recovered if we know its variance function in an arbitrary open 
domain. This is what we tentatively call local invertibility. On the other hand, if Cg are 
just linearly independent in U, then one needs to know the variance of / everywhere in 
U in order to recover it. Note that if only finitely many Cg are non-zero, then the system 
{cs}s can be neither linearly nor locally linear independent and no recovery is possible; 
this is the case with the Euclidean distance, (P{x,y) = ||a; — As we show later in 
this paper, an example of full rank a.e. kernel is the squared spherical distance in M", 
d'^{x,y) = arccog^ ( ii^^i'iJ^ii ). At this point we shall speculate that by establishing a one- 
to-one correspondence between F{V) and Cu{F(y)), one obtains new potential tools for 
studying probability distributions, especially such on non-Euclidean metric spaces. 

The local invertibility of integral operators may have direct practical implications. 
This is evident from the fact that the integral equation ([T]) and its discrete analog ([2]) 
provide an abstract formulation for many remote sensing inverse problems, where the 
goal is to study some directly unobserved phenomena / from its integral characteristic 
g = A^f, which is measurable. Then, at least in principle, the local invertibility of 
allows the measurements on g to be taken in an arbitrary domain of the measurement 
space and still reconstruct /. It is no coincidence then that all important in practice 
integral transformations, such as the Laplace transformation, are locally invertible. 

The full rank a.e. property of integral kernels may also be of importance to some 
families of discrete inverse problems. Often, linear systems of equations of type ([2]), 
with continuously changing sample points, arise naturally in problems such as the 
following variant of the n-body problem in astronomy. Let us assume that ip represents 
a gravitation field, / is a mass distribution and g is an observed effect of the field 
generated by the mass, for example, acceleration. If the gravitation field is generated 
by k otherwise freely moving objects with positions {xi}^^^, one may be interested in 
reconstructing their mass from an instant observed effect of the accumulated force on 
each of them, which yields a type ([2]) problem {yi are taken to be Xi). In this setting, 
the points {xi}^^^ will behave as if coming from a continuous probability distribution 
on the product space and the fact that the matrix Ak has full rank a.s. and thus, ([2]) is 
solvable, has an immediate significance. 

The main body of the paper is organized in three sections. We begin. Section [2l 
with a systematization of the finite rank condition for analytic kernels by presenting 
some, not necessarily new, equivalent conditions for the latter (Proposition [1]). Then, in 
Section [31 we introduce the local linear independence and derive an important necessary 
condition (Lemma [5]). In Section |H we define the full rank a.e. notion and present some 
necessary and sufficient conditions for it that hold for analytic kernels (Proposition [2] 
and Corollary [1]) . Also there, presented is a more involved example of a full rank a.e. 
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kernel - the spherical distance in two or more dimensions (Proposition H]). Finally, we 
conclude with a discussion on the usefulness and limitations of the presented results, 
and their possible further development. 

2. Analytic Kernels with Finite Rank 

In this section we present some necessary and sufficient conditions for an analytic kernel 
to have finite rank. These conditions are based upon the fundamental relation between 
kernel rank and functional linear independence. Our goal here is not to present new 
facts, but to systematize some basic results and present them in a form needed in the 
following sections. 

Let U be an open subset of M". A collection of functions fs'-U — )■ M is said to be 
linear independent in U if Ylis^sfs{.x) = 0, for almost all (in Lebesgue measure sense) 
X E U only if = for all s. It is easy to check the following necessary condition for 
linear independence. 

Lemma 1. If the functions fi{x), ...,fk{x), k>l, are linearly independent in U, then 
there exist xi, ...,Xk in U , such that rank{{fi{xj)}^j^i) = k. 

In the theory of linear operators, finite rank are said to be all kernels admitting 
representations in the form Yl^=i fji^)9jiy)y ^^r linearly independent fj and gj. We 
shall adopt, however, a different definition, based on the notion of matrix rank, which 
is equivalent to the former. The reason of not using the standard one is that our finite 
rank definition can be naturally extended to characterize full rank kernels as well and 
thus, provides more intuitive and consistent approach. 

Definition 1. We say that a function ip : U xV ^ M., U,V G , has rank k and write 
rank{ip) = k if for any m E N, Xi E U and yj G V , i, j=l,...,m, 

rank{{'^{xi,yj)}1^j^^) < k, 

and k is the smallest number with this property. 

Recall that a function / G C°°{U) is real analytic in U if it admits power series 
expansion in a neighborhood of any point x E U. Next we extend this definition 
to bivariate functions or kernels in the linear operator theory context. Hereafter, we 
assume that U and V are open connected subsets of M", although more general settings 
may be possible. We say that ip : U x V ^ is analytic in V, if about any p E V one 
can write 

oo 

for some functions Cs-^...^^ in U, such that the series on the right converges to ip{x,y) for 
any {x, y) eU xV . For the sake of brevity, we shall write the above expansion as 

oo oo 

i^{x,y) = Ycs{x){y-py ■.= Y ^ Cs{x){y-py (3) 

s 1=1 s:[s]=l 
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where s = (si,...,s„) is multi-index and [s] := Si + ... + s„. Any analytic ifji^x^y), 
therefore, is infinitely differentiable in y about any p E V, and the series ([3]) is in fact 
the Taylor series ofip iny at p, thus giving Cs{x) = jif^lp- We also silently assume that 
for aW X E U and p E V, the closed ball with center p and radius the convergence radius 
of the series ([3]), encloses the whole V. With other words, we assume that for any p E V, 
ijj admits an analytic expansion ([3]) almost everywhere in V, except, eventually, a set 
of Lebesgue measure zero. If in Q, Cs{x) are analytic in x G f/ as well, then ip is said 
to be analytic in both arguments. The main results in this paper establish connections 
between the rank of ip and some conditions on its Taylor functions Cg. 

We say that the vector space span{ci,C2, ■■■}, that is, the space of all finite linear 
combinations of c^, has a finite basis of size m, if there exist functions Cs^, Cc„, such 
that all Cs's are their linear combinations, i.e. Cg G span{cs^, Cs^} for all s. The next 
result gives some necessary and sufficient conditions for ip to have finite rank. 

Proposition 1. For any function ip : U x V ^ that is analytic in V , the following 
three conditions are equivalent 

(1) rank{ip) = k. 

(2) ip{x,y) = Yl^j=i4'j{^)ij{y) for linearly independent functions 0j : f/ — > R and 
i,eC^{V),j=l,...,k. 

(3) Let for arbitrary p G V, Cs are the Taylor functions of ip from Eq. Then, 
spanjci, C2, ...} has a finite basis of size k in U. 

Note that without the analytical requirement on ip only the link (2) =^ (1) seems 
to be evident, because the connection (1) =^ (2) goes through the Taylor expansion of 
ip- Also, if the condition (3) holds for one p E V then it inevitably holds for any other 
point in V, and therefore, to show that ip has finite rank, one only needs to show that 
its Taylor functions about one particular point have a finite basis. 

If tp is symmetric and the representation in condition (2) of the proposition holds, 
then are linear combinations of 0^. Indeed, if we choose Xj, j = l,...,k, such that 
rank{{fi{xj)}^j^{) = k, then, for any y we can solve the system 

k k 

^<Pi{xj)^i{y) = ^(f)i{y)^i{xj),j = l,...,k 

i=l i=l 

to obtain ^i{y) = ELi 

Another immediate corollary of Proposition [T] is that for analytical tp with finite 
rank, ranklip) = k, the integral operator 

A^:f^ [ ij{x,y)f{y)dy, f : U ^ R, 
Jv 

is of finite rank in sense of the standard definition from the integral operator theory. 

Next, we present probably the simplest application of Proposition [1] showing the 
finite rank of the Euclidean metric. Consider the Euclidean square distance in M", 
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ip{x,y) = ||x — ylp = Xls=i('^H ^ 1/h)^7 where X[s] are the components of x G M". 
Because of the global representation 



by Proposition [H rank{ip) = n + 2, i.e. the Euclidean metric has finite rank of two more 
than the number of dimensions. 

Another obvious example of a finite rank kernel is the circular square distance, 
■ilj{x,y) = {x — yY, x,y E = [0, 27r]. At the end of this paper we shall show that the 
spherical square distance in more than one dimensions is never of finite rank. 

3. Local Linear Independence 

In this section we introduce and describe the so-called local linear independence of a 
collection of functions, a property stronger than their linear independence. As it turns 
out, the rank of a bivariate analytic function is related to the local linear independence 
of its Taylor functions, which motivates the introduction of the latter notion. We start 
with its definition. 

Definition 2. A collection of functions fs'-U — > M said to he locally linear 
independent in U, if for any open subset W of U we have that Yls'^sfs{x) = almost 
everywhere in W if and only if as = for all s. 

Apparently, local linear independence implies linear independence. The reverse 
however is not true - a collection of functions can be linear independent in one open 
region but dependent in another. This is exactly the case with the functions 



which are not locally linear independent, because they are linearly dependent on the 
negative half of the real line. 

Naturally, the most important example of local linear independence is presented by 
the power function. 

Lemma 2. For any distinct multi-indices Si,S2,..., the power functions {x'*'};^^ are 
locally linear independent in M". 

In fact, the local linear independence of the power functions can be generalized 
to any collection of analytic functions - there is an equivalence between local linear 
independence and linear independence for any collection of analytic functions. The 
reason is that any analytic function vanishing in an open region, vanishes everywhere 
in its definition domain. Consequently, if a linear combination of real analytic functions 
vanishes in an open set, being an analytic function itself, it vanishes everywhere in its 
domain, and therefore the collection can not be linearly independent. 



n 



n 



i^{x,y) = * 1 - 2x[i]y[i]... - 2x[n]y[n] + 1 * Xl^H 



s=l s=l 
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Next, we state several elementary properties of local linear independence that we are 
going to use later. Note that any collection of translated power functions {{x — a^)*'};^^ 
is also locally linear independent. In fact, any bijection that have continuous inverse 
preserves local linear independence. 

Lemma 3. Let U and W be open subsets of and M'^, k < n, respectfully, and 
h : U W be a transformation with the property: the image of any open subset in U 
contains an open subset in W . Then, for any collection f^-.W^Rof locally linear 
independent functions in W , fs°h are locally linear independent in U . 

The assumption of Lemma [3] is satisfied by any h : U ^ W that has a full rank 
Jacobian in U, that is, since k < n, rank{Jh{p)) = k,'^p & U. 

Although, in general, local linear independence is not preserved by forming linear 
combinations, there are some special cases when this is true. 

Lemma 4. If fs : W ^ M, s=l,...,n, are locally linear independent functions and 
Qi G span{fi}, Qs e span{fi, /J \ span{fi, s > 0, 

then Qs are also locally linear independent. 

We continue with an important connection between the local linear independence 
of finite sets of functions and the rank of matrices sampled from these functions. The 
result is analogous to that in Lemma [1] and gives a necessary condition for local linear 
independence. 

Lemma 5. // the functions fi{x), ...,fk{x) are locally linear independent in U and Ui, 
i = l,...,k, are arbitrary (non-empty) open subsets of U, then there exist xi,...,Xk, 
Xi G Ui, such that rank{{fi{xj)}^j^{) = k. 

The condition in Lemma [5] is only necessary. Indeed, it is clearly not-sufficient 
for the function /(x) = jg rational}' ^ ('-''-'-)' linearly independent, less 

locally linear independent. However, if in addition functions ft are continuous, then the 
condition becomes sufficient as well necessary. 

4. Full Rank Almost Everywhere Kernels 

We continue with an introduction of the full rank notion. As it shall become clear 
shortly, the definition is a natural extension of that of the finite rank and is closely 
related to local linear independence. 

Definition 3. A bivariate function ip : U x V ^ is said to have full rank almost 
everywhere (a.e.) in U x V if for any number A; G N and open sets Ui G U and Vj C V, 
i,j = 1, k, there exist Xi G Ui and yj G Vj such that 



rank{{ip{xi,yj)}ij^^) = 
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To say that ip has no finite rank according to Definition [T], is not equivalent to 
the full rank a.e. condition. The latter implies the former, but the reverse is not true. 
Regarding the full rank a.e. kernel property, a close analog to Proposition [H although 
weaker for it provides only a sufficient condition, is the following result. 

Proposition 2. Let ip : U x V admit the representation 

oo 

for locally linear independent ^s{y) such that for any k ^N, there is a set of k functions 
(f)s{x) that are locally linear independent in U . Then ip has full rank a.e. in U x V. 

Proposition [2] states only a sufficient full rank condition. It turns out that for 
analytic in both arguments kernels, this condition becomes necessary also. In fact, the 
next result is a corollary of Propositions [1] and [2l 

Corollary 1. If ip is analytic in U x V , then ip has full rank a.e. in U x V if and only 
if for the Taylor functions Cs{x) of tp about any point p G V and every k eN, there is 
a set of k functions Cs{x) that are locally linear independent in U . 

We can apply the above result to a large class of symmetric analytic functions. 
Let x.y = YM=i^[i]y[i] denote the dot product in M". Consider the class of functions 
ip{x, y) = h{x.y), (x, y) E U x V, where W = {x.y\x E U, y E V} C M, E V , and h is 
analytic function in W such that h^^\0) ^ for infinitely many s. The Taylor functions 
of ip{x, y) at y = are 

and since any finite collection of power functions is locally linear independent, for any k, 
there exist k functions Cg that are locally linear independent in U. Then, by Proposition 
[21 ijj has full rank a.e. in U x V. As an illustration, one can show the full rank a.e. 
property of the Laplace kernel ip{x,y) = exp{—x.y). Other examples of kernels of the 
same kind are cos{x.y) and arccos{x.y). 

For subsets Ui, I = l,...,m, of W^, with ®IILif/; we shall denote the product 
Ui X ... X Um- Let /i be the Lebesgue measure in M". For the product (8>[^if/; of 
measurable Ui, by ^i{®iUi) we shall understand its Lebesgue (product) measure as a 
measurable subset of M""*. To motivate the usage of "a.e." notion in our definition of 
full rank, we need the following measure-theoretic result, which is of interest by itself. 

Proposition 3. Let f he an analytic function in an open subset U o/R" such that the 
set Vq := {x G U\f{x) = 0} has no interior points, then Vq is measurable and /u(Vo) = 0. 

Note that if the function ip{x,y) is analytic in U x V, then for any A; > 1, 
f{xi,...,Xk,yi,...,yk) = det{{ij{xi,yj)}'^j^^) is an analytic function in (®f=if/ ®f=i V^). 
If in addition, ip has a full rank a.e. in ?7 x V^, then, by the virtue of Proposition [3l we 
have immediately the following result. 
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Corollary 2. If ip : U x V ^ 'K is analytic in V and has full rank a.e., then for any 
k > 1 the set 

Dk := {(xi, G ®ti V, s.t. rank{{ip{xi,yj)}lf^^) < k} 

has (product) measure zero, yu(-Dfc) = 0. 

Indeed, the set Dk is closed and has no interior points, for otherwise 
det{{il){xi,yj)}^ will vanish in an open subset and ip will not have full rank a.e.. 
Essentially, this corollary motivates the use of "a.e." notion in the full rank definition. 

Finally, we present a non-trivial example of full rank a.e. kernel - the standard 
distance on the unit sphere. 

Proposition 4. The standard distance on the n-sphere, §"", n>2, given by 

arccos{p.q),p,q G §" C M"+-^ 

and its square have full rank a.e. on 

The above result has a probabilistic formulation as well: for every k, the square 
matrix with entries arccos'^{pi.qj) of random points pi and qj, i,j = 1, k, on a unit 
sphere 5", n >2, sampled independently by a continuous distribution on the sphere, is 
non-singular with probability one. This is evident by the completeness of the Lebesgue 
measure. More specifically, by continuous distribution we understand one that has a 
density, i.e. is absolute continuous with respect to the Lebesgue measure. Then, the 
probabilistic formulation above follows from Corollary |2j 

Remark 1. The full rank a.e. property of arccos{x.y), x,y eS"" can be inferred from 
another standard result in the linear operator theory. In the Hilbert space L2(S"') of 
square integrable functions on the operator with kernel arccos{x.y) is symmetric 
and thus arccos{x.y) = J2k>i ^k(pk{x)(f)k{y) , where Xk and (pk are the eigenvalues 
and eigenvectors of this operator (see the Theorems of Hilbert and Schmidt, Sec. 
97). Since (pk's form an orthonormal system in L2(S"), they are necessarily linear 
independent. Moreover, one can expect that they are locally linear independent, though 
one still has to show it. Our approach however, has an advantage in two aspects: (1) 
finding the Taylor functions of arccos seems simpler than finding the spectral functions 
(pk, and (2), in general, we do not need the Hilbert space assumption. 

5. Concluding Remarks 

We return to the question stated in the introduction: when can the solution of an 
integral equation ([1]) be approximated by discrete solutions of the linear system of 
equations ([2])? The answer will be positive if, first, ([1]) has an unique solution /, and 
second, the series of solutions fk of ([2]) converge to / in an appropriate sense, a.s. or in 
some L^-norm. The full rank a.e. condition on the kernel ip guarantees the existence of 
/fc, but unfortunately, is not enough for the invertibility of the operator A^, for equation 
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([T]) may still have multiple solutions. This is illustrated by the next example. Let for 

{x,y) G (—00,00) X (0,00) 

s=l 

This kernel ip has the form ([3]) with Taylor functions C2s-i{x) = and C2s{x) = 
The conditions in Proposition [2] for ip are satisfied and thus, ip has full rank a.e.. On 
the other hand, Cs{x) are not linearly independent and one easily finds that is not 
invertible. Indeed, for f{y) = e~^, we have {A^f){x) = 0, for all a; G M, and therefore, 
is an eigenvalue of the operator A^. 

The invertibility of A^ however, can be guaranteed under some additional 
conditions. Let ip be analytic in y & V and the Taylor functions Cs{x) in the analytical 
development of he linearly independent in U. Let r > be the convergence radius 
of the Taylor expansion of ip in y. For r < 00, consider the vector space P(^) 

F(y) := {all measurable f : V R, s.t. sup{r"'' / \f{y)y''\dy} < 00} 

s>l Jv 

equipped with the norm and let F{V) = L^iV), if r = 00. Assume that A^ is a 
bounded and closed operator from F{V) to L^{U). A sufficient condition for the latter 
is suppg(Q,,) P** lu \cs{x)\dx < 00. Then, A^ cannot have as an eigenvalue because 
the equation 

00 „ 
{A^f){x) = J2cs{x) / y'^f{y)dy = 

s=i Jy 

has no non-zero solution for /; otherwise Cg will not be independent. In this case, 
A^ : ¥{y) — > Im{A^) C L^iU) is a one-to-one map. Consequently, for any g G Im{A^), 
^ipf = 9 has a unique solution /. If in addition ip has full rank a.e., we can construct a 
series of the discrete invertible operators Aj^ G M.^^ , k = 1,2, that converge uniformly 
to A^, \ \Ak — A^\ \ — 7- (recall the setup in the introduction). Let also gk such that 

\\9k ~ fi'll and := A^^g^ G M*^. Now, for any convergent subsequence fk', k' C k, 
ll/fc' ~ /oil 0, by the uniform convergence of Ak, we have 11^4^'/^' — v4^/o|| 0. 
On the other hand, Ak'fw = gk', and hence, A^fo = g and /o = /. Therefore, 
ll/fc' — / II and we have the desired convergence to the unique solution of A^f = g. 
Unfortunately, we cannot guarantee the existence of a convergent subsequence of fk- In 
fact, if A^ is compact, then there will be denumerable many eigenvalues concentrating 
at 0, A^'^ will be unbounded and the problem of approximating / will be severely 
ill-posed - the ill-posedness of the Fredholm integral equations of first kind is a well 
known problem. Nevertheless, we find the principle possibility of inverting A^ and all 
of its discrete approximations, the matrices Ak obtained by random quadrature, to be 
sufficient motivation for this study and deserving some further investigations. 

Note that if ip is analytic in V and its Taylor functions Cs{x) are locally linear 
independent in U, then ip is of full rank a.e. and any restriction A^l^i^w, for open 
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W C U, is an injective operator - this is what we understand by local invertibility. 
With other words, any function / G ¥{V) is possible to be recovered from g = A^f, 
if its image g is only known in some arbitrary open W. Even when is intractable with 
quadrature in practice, because of the ill-posedness, such recovery remains a principle 
possibility that eventually can be achieved, for example, with regularization methods 
targeting restricted classes of functions. As seen from the proof of Proposition |U the 
squared spherical distance is an analytical kernel with locally linear independent Taylor 
functions, and hence, is an example of full rank a.e. and locally invertible integral 
operator. 
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Appendix A. Proofs 

Proof of LemmaUl We show the claim by induction. Since fi{x) is not identically 
zero, there is Xi G f/ such that 7^ 0. Let us assume that we have k — 1 

points xi,...,Xk-i in [/, such that det{{fi{xj)}'ljli) 7^ and for s = l,...,k define 
As := det{{fi{xj)},i = l,...,k,i 7^ s;j = l,...,k — 1). Since A^-i 7^ and fi are 
linearly independent, we can choose Xk E U such that for x = Xk 

f flixi) /2(xi) ... fkixi) ^ 

fliXk-l) f2iXk^i) ... fkiXk-l) 
\ flix) f2{x) ... fk{x) j 

which proves the claim. □ 

Proof of PropositionUi We shall show that (3) =^ (2) =^ (1) =^ (3). Let condition (3) 
hold and 0i, 0^ be a basis of span{ci, C2, ...}. Then, for any s, Cs{x) = X]i=i f^l^Pii^) 
and ^p{x, y) = Ei=i(Es l^liy-py)^^)^ provided that for any i and ?/ G V, Y.s l^liv-pY 
converges pointwise. Suppose the converse, that there exists io and yo G V such that 
Ss/^s°(?/o ~ pY does not converge. Since 0j's are linearly independent, we can choose 
Xj E U, j = 1, k, such that rank{A := = k. Let ||v4~-'^|| > denote the 

operator norm of matrix A"^. Fix a number e > 0. Since all '^s{xj){yo—p)^ converge 
absolutly, there is N such that 

M k 

I ^(^/3:0,(x,))(2/o-p)1<6, 

[s]=N 1=1 

for any j and M > N. On the other hand, by the divergence assumption, there is 
M > N, such that 

M 

I J]/3r(l/o-pri>v^p-'||e. 

[s]=N 



k 

= Y,i-^y^'Aj,{x) + 0, 
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Define the k-vectors z = {zi, ...,Zk)^ and w = {wi, ...,WkY , where 

M M k 

■= Yl (^iiVo-Py and Wj := ^ /3^0,(xj))(i/o - p)'- 

[s]=N [s]=N i=l 

The system Az = w can be solved for z, z = A^^w and therefore \ \z\ \ < \ \A~^\\ \\w\ \ < 
^/k\\A~'^\\e, which contradicts H^H > \zig\ > |^~^| |e. Hence, the initial assumption 
is false and all 

oo 
s=l 

are well defined functions in V and condition (2) holds. 

That (1) follows from (2) is immediate. Apparently, the rank of can not be 
larger than k. Moreover, by the linear independence assumption and Lemma [H there 
are Xj G U and yj E V, j = l,...,k, such that rank{A := = k and 

rank{B = {C,i{yj)}ij=i) = k. Therefore, for \E' := {'ip{xi,yj)}ij^i have \E' = AB'^, 
which implies ran/c(\E') = k. 

Next we show (1) =^ (3). Let rank{il)) = k. For fixed Xi E U, i = l,...,k + 1, 
consider the set y), ...,ip{xk+i,y)} of functions in V. Since for any k + 1 points 

yj G V, no full rank matrix exists, by Lemma [H {^'(xj, are not 

linear independent. Then, there are functions ai{x) of x = (xi, x^+i), not all zero for 
any x, such that 

fc+i 

Yai{x)'ilj{xi,y) = 0,\/y e V. 
1=1 

By Taylor expanding ip in y about a point p E V we obtain 

k+1 

^^ai(x)c,(xi)(?/-p)" = 0,V?/ G V, 

s i=l 

implying Ylt=i Oii{x)cs{xi) = 0, Vs. The latter is true for any Xi G U, i = 1, ...,k + l and 
therefore, again by LemmalU no set of fc + l functions is linearly independent. On the 
other hand, there is a set of k functions Cg that is linearly independent, for otherwise, 
following (3) =^ (2) =^ (1), we would have that rankijp) < k. Consequently, there exists 
a set of functions among c^, such that for any s, Cs{x) = Yl'i=i t^l'Pii^) y 

i.e. Cs G span{0i, Thus, the condition (3) is fulfilled. □ 

Proof of Lemma [H We will show the claim by induction on the number of dimensions. 
Let us first convince ourselves that it is true for n = 1 and U = {a — 6,a + 6), 6 > 0. If 
Y^'^i Oiix^^ = 0, Vx G (a — 5, a + 5), then the above power series has radius of convergence 
at least p := max{|a — 5|, |a+5|} > 0. Hence, / := Xl/^i being an analytic function 
in (— p, p), vanishes everywhere in (— p, p), which leads to the only possible choice ai = 0, 
for all /. 

Now, let n > 1, X = (x[i], ...,X[„]), and assume that all sets of power functions in 
n — 1 dimensions are locally linear independent. If a;X'^' = in [/ C M", then the 
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series will be absolute convergent in U (we may eventually need to shrink U a bit so that 
the closure tJ is entirely within the radius of convergence of the series). Consequently, 
we can regroup by Xl« "i^;*' = Zlfeli(Zli:si=fc where x := (xp], ■..,X[n]), 

Si = [sl,s^~^] and s"~^ is a (n — l)-multi-index. Applying the argument from the 

n-~l 

first part of the proof, we have ^^.^i^;. aixfi = in f/ for every k. Finally, by the 
assumption, the only possible choice is ai = 0, for all I. □ 

Proof of Lemma We can repeat the lines of the proof of Lemma [T] with the only 
change at each selection step: choosing Xi G Ui instead of Xi G U. 

Since can not be identically zero in f/i, there is Xi G Ui such that fi{xi) ^ 0. 
Assuming that there are Xi G Ui, i = 1, .., k — 1, such that det^A^ := 7^ 0, 

we can choose Xk G Uk such that for x = Xk 



det 



( fl{xi) /2(xi) ... /fc(xi) \ 

k 

f2{Xk-l) ••• fk[Xk^l) 
V fl{.x) f2{x) ... fk{x) J 



Otherwise, if such choice is impossible, Yl'i=i = 0, Vx G Uk and would not be 

locally linear independent. □ 

Proof of Proposition The convergence of the right-hand series in (j4]) is assumed to be 
in absolute sense. Thus, X^^i \'Ps{x)^s{y)\ < 00, for aA\ x E U and y eV. 

Suppose that for a number k there exist open sets Ui dU and Vj C V , i,j = 1, k, 
such that for all Xi G Ui and yj G Vj, rank{{ilj{xi,yj)}'^j^^) < k. If we fix Xi G Ui, 
i = 1, k, then, by LemmaO {ip{xi, y)}i=i are not locally linear independent functions 
of y in V. Consequently, for the fixed x = (xi, ...,Xk), there exists an open set W{x) C V, 

zero, such that 



where {4'{xi,y)\w{x)}i=i are linearly dependent, or equivalently, there are ai{x), not all 



k 



^a,(x)^/'(xi,?/) = 0,V?/ G W{x). 
1=1 

Taking into account the given representation (jlj) of ip, we can write 

00 k 

J] J]a,(x)</),(x,)e,(y) = 0,Vy G W{x). 



=1 't=i 



The local linear independence of C,s then guarantees that X]f=i '^«fe)*i^s(^i) ~ 0,Vs. 
Therefore, for any choice of indices si, ...,Sk, rank{{(f)sj{xi)}f .j^i) < k. Since the latter 
is true for any Xi E Ui, i = l,...,k, by Lemma [5], no k functions (pg would be locally 
linear independent in U, a contradiction with the proposition assumption. Therefore, ijj 
has full rank a.e. in U x V. □ 



Proof of Corollary m By ip being analytic in U x V we mean that for every p E V, 
ip{x,y) = J2s^s{x){y — pY, for analytic in U functions Cs{x). The sufficiency then 
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follows from Proposition [21 which can be applied because {y — p)'^ are locally linear 
independent in V. 

Next, we shall check the necessity. Let ip have full rank a.e. in U x V and there is 
p & V and k such that there is no a collection of k Taylor functions that is locally 
linear independent. But the local linear independence of the analytic functions Cg is 
equivalent to their simple linear independence and thus, there is not set of k functions 
Cg that is linear independent in U. Then, span{ci,C2, ■■■} has a finite basis of size at 
most k in U and, by Proposition [H ranklip) < k. This contradiction with the full rank 
assumption on ip proves the necessity. □ 

For what follows, we need the following fact. 
Lemma 6. Any collection O of (nonempty) open and disjoint subsets o/M" is countable. 

Proof of Lemma\^ Let O E O. Then there is at least one vector q E O with 
all rational coordinates. By applying the axiom of choice we define a map 6 : 
O {ki,li, k2,l2, knjn), whcrc ki, li, i = l,...,n, are integers such that q = 
{2^Hi, ...,2'="/„) e O. C is countable since 9 is injective map from O to Z^". □ 

Proof of Proposition^^ Define Vi := {x G f/|^|a; = 0}. When n > 1, ^ is a gradient 
vector and |f U = means that all partial derivatives at point x vanish. Both Vq and 
Vi are closed in U. We shall show that Vo\Vi has measure zero. 

By the implicit function theorem, for any point x G Vo\Vi there is an open ball 
Bx = Bx{rx) of radius r^, > and a hypersurface Sx of dimension n — 1, the graph of 
a function of n — 1 variables, such that x E = Vq\Vi. We have ^{Sx) = 0. 

Note that any two Sx and Sy that intersect and are images of open subsets of a common 
coordinate plane, say = 0}, can be combined to the image of a continuous function 
in {x[i\ = 0}. We have therefore the representation Vo\Vi = U^L^ Uag^, S^^, where all S^^ 
are disjoined images of continuous functions in {x[i\ = 0} and as such fi{SU = 0) 



Let [/^ = Uxes^^Bx{rx/2). Then it must be that f] = ill, \/a ^ 13 e Ai. 
For otherwise, there would be a; G 5*^ and y E S'^^ such that Bx{rx/2) fl By{r-y/2) ^ 
and consequently, either x G Byivy) or y G Bxijx)- If for example y G Bx{rx), then 
y E Sx and y E Sx H Sy, and therefore S^^H S^ ^ 0, which would be a contradiction. 
Hence, by the virtue of Lemma [6l for every i, the disjoint open sets {U^}a are at most 
countably many, that is, the index sets Ai are countable. Therefore, /i(Vo\Vi) = and 



We can repeat the same analysis for higher derivatives of order / > 1 and apply 
induction on /. Define 



Va G Ai. 



fi{Vo) = fi{v,nVo). 



Vi ■= {xeU s.t. 



d'f 



for all s = (si, ... 



Sn) for which [s] = I}. 



dx'^ 



X 



We claim that /x(V/_i\VJ) = for all I > 0. We have already showed the claim for / = 1. 
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For any s = (si, s„) for which [s] = / — 1, define 

V,U ■■= {xeUs.t. |^U = 0}, Vr-={xeUs.t. £^|, = 0, for all j = l, ...,n} 

and observe that V5_i = r{s;[s]=i-iV{!_i and Vi = ns:[s]=/_iV5''. The argument from 
the first part of the proof for showing UniVo) = UniVi fl Vq) is applicable to all pairs 
(V;ii,y/) and consequently /i(V^ii) = /"(^' ^ V^iJ, Vs, [s] = I - 1. Next, we 
use the fact that for any four measurable sets A, B, C and D, satisfying B G A, 
li{B) = fi{A), D C C and fi{D) = fi{C), we have fi{B n D) = fi{A nC), to conclude 
that /i(n[,]=;_i\/;ii) = /i(n[,]=;_i(V;ii n Hence we have /i(VJ_i) = /i(VJ„i n VJ) and 
Ai(VJ_i\Vi) = 0. Now, assuming that /i(Vo) = /i(n^lo^m), from 

we obtain /i(Vo) = /i(n^^QKn) and by the induction principle the latter is true for every 

Note that /i(n^^QKn) \ fJ'{^m=o^m), as / — )■ oo. Finally, we realize that the set 
nj^^o^m should be empty, for otherwise, with all vanishing derivatives at one point, the 
analytic function / would vanish in an open subset of U, a contradiction. Thus we 
conclude that /x(Vo) = nin'^^^Vm) = 0. □ 

Proof of Proposition Consider the following parametrization of the north hemisphere 
about the north pole: 

n 

(j):x = (xi,X2,...,x„) G = (xi,X2,...,x„, (1 -^x])^'^) G M"+\ 

where O" = {x G [0, 1]"", XliLi < 1 is the closed n-ball. Then the inner product of 
p = and q = (f){y) is 



n n n 



p.q = m-m = Y.'^^y^ + - - E^?^'^' 

i=l j=l j=l 



The proof of the desired claim is based on application of Proposition [2l For the purpose 
we need to derive the Taylor functions fs{x) in the expansion of arccos{p.q) in y at 
G M". Specifically, we need to show that for any k, there are k locally linear 
independent fs{x) in O". We will first show this property for the Taylor functions 
of 

ip{x,y) = arccos{(f){x).(f){y)), x,y E O", 

and then for the square spherical distance ip"^. Note that ip is analytic in O" x O". 

The first simplification we are going to make is to fix ?/2 = • • • = 1/n = and consider 
ip{x, y) as a function of yi G [0, 1]. Then, it suffices to show the local linear independence 

dyf 



condition only for the partial derivatives 
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For brevity, denote x = (XliLi ^D^''^ V ~ ^■^^=iy'iY^'^ ■ "^^^ form of the first 
few derivatives of 2; = (j){x) .(f){y) as a function of yi 

a^/, (1 _ ^2)1/2^1' 5^2 - (1-^2)1/2 (1_ ^2)3/2^1' 



can be generalized (the proof is by induction) to the following equations 

dz d^^^^z d'^^z 



S/=0 = ^1' 7r2fc+Tl2^=0 = 0, 7T-2fc l2/=0 = -^^(1 " ^Y'\ ^ > 1, (A.l) 



for some integers ak > 0. 

On the other hand, the general form of the derivatives of ipi^) = arccos{z) 



Q^2s Q _ _22y2s+2«-l)/2 ' 

Z=l ^ ' 

/ ,02s+lJ- 



^^2s+l "zs+i,( Q _ ^2'\{2s+2i+l)/2 • 



calculated at 2 = (1 — of Y^^ (corresponding to y = 0), can be summarized to 



d'^, _ 1 fii-x^y/\i 

= (l-x2)l/2 

for some integers numbers bg^i > with bg^s-i > 0. Formally, f lA.2p can be verified by 
induction. 

Next, we combine equations (lA.ip and (IA.2p to express the partial derivatives of ip 

in j/i 

where di^i^,,j^ are some integers and the second sum is over all li < ... < 1^. For example 

dip dip dz xi 

dyi ^~ dz dyi x ' 

d'^ip d'^ip / dz Y dipd'^z {'^ — x^Y^'^ 2 ^ 

dyf dz"^ \ dyi J dz dyj x x 

The complex form of these functions, which mix Xi with x, renders the verification of 
their local linear independence untractable. Fortunately, at this point we can do further 
simplifications by taking into account that n > 1. If we fix xi = and show that for 
any k, there are k local linear independent functions ^:^\xi=o,y=Q{x2, ■■■,Xn), our claim 
will be proven. Note that this step can not be taken if n = 1. Indeed, we have already 
verified that the claim is not true for the 1-dimensional circle (recall the example at the 
end of Section [2]) . 
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First, observe that ^^^\xi=o,y=o{x2, --^Xn) = 0, because £^|a,^=o,y=o = 0, for all 
k > 0, and all terms in Eq. { \A.3\i must have at least one odd Ij. Second, plugging flA.ip 
and ( 1A.2P in (]A.3|) and denoting diii2...i^ = ai^ai2...ai^d(2h)(2i2)...i2ik), we obtain 



2s 



dyj 

k=l 1=0 — li+...+lk=s — 



X 



where Pg is a polynomial with integer coefficients of degree 4s — 1. Hence, by introducing 
the functions h{x2, •••,a;„) = ^^~~J — , we conclude that 

-^^|xi=o,j/=o(a:2, •••,a;„) G span{h, h^''~'^}\span{h, h'^"'^}, s > 1.(A.4) 

Finally, by Lemmas [3] and HI we assert that indeed, for every finite set of distinct even 
numbers s, the corresponding partial derivatives flA.4l) are locally linear independent. 
The conditions of Proposition [2] therefore hold and the spherical distance has full rank 
a.e. (in the north hemisphere). 

Now we consider the square spherical distance. From the equality 

for some integers e| > 0, we conclude that at the point (xi = 0,?/ = 0) 

^ ^-(xa, ...,a;„) = 0, 



dy'r' 

-^[x2....^xn) = m-^'f")Ps[- — =^)+Qs[- — ^ 



,(A.5) 



where Qs = ^l=i elPkPs-k is a polynomial with integer coefficients of degree 4s — 2. 

Let us assume that for some k, the first k even derivatives (lA.Sp are not locally 
linear independent. Let t = — . Then, there are some with Cjt 7^ 0, such that 

J2cs[Ps{t)arccos{ ) + Q,{t)^ =0,teW, 



=1 



in an open (non-empty) W C [0, 1]. This is equivalent to 

where P = Yl'l=i '^sPs and Q = Yl^=i CsQs are polynomial of degrees 4/c — 1 and 4fc — 2, 
respectively. After taking the derivatives on both sides of the above equation and 
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applying some algebra we obtain the equality (P(t))^ = (1 + t'^){P{t)Q'{t) — Q{t)P'{t)). 
The latter however is impossible because of the degree disparity, 8k — 2 for and 
8A; — 3 for the left-hand side polynomial (we use that degree{P {t)Q' {t) — Q{t)P'{t)) < 
degree{P) + degree{Q) — 2). This proves the local linear independence of the first k 
even derivatives (]A.5I) . Due to Proposition O the square spherical distance has full rank 
a.e. in □ 



